Human Dimensions of Corpora Comparison: An Analysis of Kilgarriff's (2001) Approach

نویسندگان

  • Kathryn Parsons
  • Agata McCormac
  • Marcus Butavicius
چکیده

There is a distinct lack of tools that provide a comprehensive measure of the similarity between corpora. Finding similar corpora is necessary for the design of certain user studies investigating text processing. It is also useful for ensuring comparability between studies on document analysis conducted across classified and unclassified domains. In this study, human judgements of corpora similarity were obtained as a gold standard. These were then compared to the values provided by Kilgarriff’s (2001) chi-square (Χ2) statistic. The findings indicated a high level of agreement between the participants, with 77% shared variance in overall similarity judgements. The results of the Χ2 measure also correlated well with the human results, with a correlation of approximately 0.66. Although there are complexities associated with the Χ2 technique that need to be examined in further research, this study provides extremely promising results, suggesting that a statistical technique could provide results that are comparable to human judgements.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Modeling and Analysis of Dimensions of Agile Hospital Supply Chain Management with Interpretive-Structural Approach (Case Study: Public Hospitals in Rasht)

Background and Aim: The overall goal of the medical department is to develop and manage an efficient and effective supply chain. Intrinsic instability and unpredictability of treatment needs to require a flexible supply chain. Agility reflects the hospital's response to environmental changes, and agile hospitals are able to provide appropriate services to the patients. Hospital supply chain man...

متن کامل

Holistic View in Medicine

Modern medicine was born in modernism period around two centuries ago with materialistic view in general and pure biologic approach to health and disease. This new kind of approach was based on the wide spread philosophic view of that era especially the hypotheses of Claude Bernard. As our understanding of human biology has tremendously progressed, and the emergence of postmodernism era has o...

متن کامل

A ‎n‎ew weighting approach to Non-Parametric composite indices compared with principal components analysis‎

Introduction of Human Development Index (HDI) by UNDP in early 1990 followed a surge in use of non-parametric and parametric indices for measurement and comparison of countries performance in development, globalization, competition, well-being and etc. The HDI is a composite index of three indicators. Its components are to reflect three major dimensions of human development: longevity, knowledg...

متن کامل

DETECTION AND RESTRICTION ANALYSIS OF C YTOMEGALOVIRUS DNA PERSISTING IN HUMAN ATHEROSCLEROTIC PLAQUES USING POLYMERASE CHAIN REACTION

The polymerase chain reaction (PCR) as applied to detection of a foreign DNA in clinical specimens could provide a sensitive instrument for rapid detection of viral DNA persisting in tissues of patients suspected of latent infection. Human cytomegalovirus (HCMV) DNA was found in arterial plaques of patients with atherosclerotic lesions using a PCR assay with nested primer oligonucleotides ...

متن کامل

Designing a Model for Estimating the Value of Human Assets, based on the Non-monetary Valuation Approach in Guilan University of Medical Sciences

Abstract Introduction: The ability to record the value of human assets in a financial statement is one of the requirements of modern human resource management. Objective: Design a model for estimating the value of human assets using a non-monetary valuation approach in Guilan University of Medical Sciences and prioritizing its indicators. Materials and Methods: The research method was combin...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009